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On the trade-off between control performance 
and communication cost in event-triggered 

control 

Burak Demirel*^ Vijay Gupta^, Daniel E. Quevedo^ and Mikael Johansson* 


Abstract 

We consider a stochastic system where the communication between the controller and the actuator 
is triggered by a threshold-based rule. The communication is performed across an unreliable link that 
stochastically erases transmitted packets. To decrease the communication burden, and as a partial pro¬ 
tection against dropped packets, the controller sends a sequence of control commands to the actuator in 
each packet. These commands are stored in a buffer and applied sequentially until the next control packet 
arrives. In this context, we study dead-beat control laws and compute the expected linear-quadratic loss of 
the closed-loop system for any given event-threshold. Furthermore, we provide analytical expressions that 
quantify the trade-off between the communication cost and the control performance of event-triggered 
control systems. Numerical examples demonstrate the effectiveness of the proposed framework. 

Index Terms 

Event-triggering algorithms; Linear systems; Communication networks; Packet loss; Networked 
control 


I. Introduction 


M any textbooks on sampled-data control, e.g., [2, 3], exhibit periodic control as the unique 
way to implement feedback control laws on digital platforms. The rationale behind this 
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choice is that there exists a well-developed theory that allows to analyze the stability of closed- 
loop systems, to evaluate their control performance, and to design optimal controllers. Despite all 
these advantages, periodic implementations might lead to an inefficient use of the communication 
medium. For instance, transmitting the same actuator value repeatedly when the system is at 
rest at the desired state is undoubtedly a waste of communication resources. In contrast, event- 
triggered implementations of feedback control laws adapt the use of the communication channel 
to the needs of the physical system. Since event-triggered implementations of control laws are 
often able to achieve a satisfactory performance using significantly reduced communication rates 
(see e.g., the tutorial paper [4] and the references therein) they have emerged as an attractive 
alternative approach to the traditional periodic implementations. A reduced communication rate 
decreases the energy consumption at the transmitter side and reduces the network congestion 
when the communication takes place over a shared medium. For all these reasons, event- 
triggered implementations have been receiving an increasing attention in many applications 
including, e.g., control over communication networks [5-9], multi-agent systems [10], distributed 
optimization [11], and embedded control systems [12]. 

A. Related Work 

A number of different event-triggering mechanisms have been proposed in the literature. These 
can be broadly categorized as Lyapunov-based [11-15], model-based [16-18], or threshold- 
based [19-21]. It is widely recognized that event-triggered implementations can decrease the 
communication load in a networked control system compared to periodic ones while still guar¬ 
anteeing closed-loop stability and performance [22-24]. However, quantifying the expected 
transmission rate of such implementations for specified performance in closed-loop is chal¬ 
lenging. A notable work in quantifying such a relation is that of Astrom and Bemhardsson [23] 
who focused on the threshold-based event-triggered implementation of an impulse control of 
a single integrator system under Wiener process disturbances. They established that the event- 
based implementation gives a better performance than the traditional periodic implementation in 
terms of the state variance. Similarly, Henningsson et al. [24] proposed event-triggered control 
scheme and compared the achievable performance by using this scheme with respect to periodic 
control. Rabi [25] designed the joint optimal event-triggering mechanism and the control law 
to minimize the average energy of the state signal. However, the authors of [23-25] consider 
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a scalar system to be controlled, which affords significant simplifications of the analysis. More 
recently, Meng and Chen [26] extended the work of [23] to a class of second-order stochastic 
systems, and showed that, for the same average transmission rate, the event-based impulse control 
outperforms the periodic one. Nevertheless, as stated in [26], extending the proposed technique 
to consider more general system dynamics remains an open and challenging problem. 

The analysis becomes even more involved when the network is unreliable. Blind and All- 
gower [27] extended the work of [23] to the case where transmissions from the sensor to the 
controller take place over an unreliable link. They analytically derived the control cost and the 
expected inter-event times for different packet loss rates. Rabi and Johansson [28] designed the 
optimal impulse control and the level triggering mechanism under packet losses with multiple 
loops sharing a common network. From a different perspective, Quevedo et al. [29] analyzed 
the stability of an event-triggered implementation of a controller in the presence of packet losses 
and limited processing resources. However, in all these works, the unreliable channel appears 
between sensor and controller, while the controller-actuator communication is lossless. 

In this paper, we study a threshold-based event-triggered control loop with unreliable communi¬ 
cation between the controller and actuator. We develop a framework for quantifying the closed- 
loop performance and the expected communication rate between the controller and actuator 
without any restriction on the order of the system under control. As a control strategy, we apply 
packetized control, which is a well-known technique in the presence of unreliable communication 
channels; see, e.g., [30-32]. There are only a few studies in the literature on the blend of 
event-triggered control and packetized control; e.g., [29, 33, 34]. To the best of our knowledge, 
this paper is the first attempt to characterize analytically the trade-off between the expected 
communication rate and the control performance in the event-triggered control using a packetized 
control strategy. 

B. Main contributions of the paper 

The main contribution of this paper is to provide analytical expressions that quantify the trade¬ 
off between communication cost and control performance in packetized event-triggered control 
systems with unreliable controller-actuator communication. We consider a linear stochastic sys¬ 
tem where the communication between the controller and the actuator is dictated by a threshold- 
based event-triggering algorithm. The communication is across an analog erasure channel that 
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stochastically erases transmitted data at any time step. We consider the cheap control case with 
the controller chosen to minimize the state variance. Using a Markov renewal process-based 
framework, we are able to establish analytical expressions for the expected communication rate 
and the control performance as measured by a linear-quadratic cost. 

C. Outline of the paper 

The rest of the paper is organized as follows. In Section II, we introduce models of the process 
and communication channel, describe the control architecture and the event-triggering rule and 
specify measures of communication cost and control performance. Sections III and IV presents 
our main results, first for scalar, and then for higher-order systems. Numerical examples in 
Section V illustrate the power of our framework. Finally, concluding discussions and directions 
for future work are given in Section VI. The appendix provides detailed proofs of the main 
results. 

D. Notation 

We write N for the positive integers and Nq for N U {0}, and we use M for the real numbers. 
Let M”q denote the set of non-negative real vectors of dimension n, and M” denote the set of 
real vectors of dimension n. Vectors are written in bold lower case letters and matrices in capital 
letters. If u and v are two vectors in the notation u < v corresponds to the component¬ 
wise inequality. The set of all real symmetric positive semi-definite matrices of dimension n is 
denoted by S”q. We let 0^ be the n-dimensional column vectors of all zeros. In be the vectors 
of all ones. For any given a; G M”, the i^o norm is defined by || x ||oo= max \xi\. For a square 

l<2<n 

matrix A, Tr(A) denotes its trace, |yl| its determinant and Amax(^) its maximum eigenvalue 
in terms of magnitude. In symmetric block matrices, we use * to represent elements implied 
by symmetry. Let X = lyap(yl, Q) denote the positive semi-definite solution of the discrete 
Lyapunov matrix equation: AXA'^' — X -f Q = 0, for any given Q G S”o ^ ^ j^nxn 
Amax(^) < 1- The notation{xk} ketc stands for {x{k) : k G /C}, where /C C Nq. We use the 
symbol to denote the indicator function of the set A. The probability of an event Q is 

denoted by P [U] and the conditional probability of Q given F is written as P [U | F]. When x 
is a stochastic variable, E[x] stands for the expectation of x> Var[x] stands for the variance of 
X and Cov[x] stands for the covariance of x- An n-dimensional vector of real-valued random 
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variables x = [xi ■ ■ ■ XnY follows a multivariate normal distribution with mean fi G W and 
covariance matrix S G S”o’ denoted by S), if its probability density function is given by 


/(a;; 


(27r)t|S|5 


The cumulative distribution function F(e; /x, S) is defined as 


( 1 ) 


T(e;M.2) A 


(2ir) 




X 


( 2 ) 


Suppose one or more variates of multivariate normal random variable x are subject to one-sided 
or two-sided truncation, i.e., e~ < x < e^. Then, x has a truncated normal distribution and its 
probability density function is given by 


/(a;;^,S,e ,e+) 


g-|(a;-/x)TS 



g-|(a:-/x)TS 


(3) 


There are many techniques for sampling from truncated multivariate normal distributions, such 
as techniques based on the accept-reject algorithm and Gibbs sampling [35]. The R package 
mtmvnorm [36] provides several efficient methods to work with truncated random variables. 


II. Problem formulation 

This section summarizes the control architecture of our event-triggered control scheme and 
introduces the assumptions under which we will develop the performance analysis. 


A. Control architecture 

We consider the feedback control loop shown in Fig. 1. A physical plant Q, whose dynamics 
can be represented by a linear stochastic system, is being controlled. A sensor S takes periodic 
samples of the plant state Xk and transmits these to the controller node. The controller C is event- 
triggered and computes new actuation commands only at times when the plant state satisfies the 
event-triggering condition || ||oo> e for a given threshold e > 0. The communication between 

the controller C and the actuator A is lossy, and control packets are dropped at any time step 
independently of each other, with probability pi e (0,1). As partial protection against these 
losses, the controller sends a sequence of predicted commands in each packet. The predicted 
commands are placed in a buffer at the actuator. In the absence of new control packets, the 
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Buffer 



Fig. 1. Block diagram of event-triggered control system with a (linear) plant Q, a controller C, a sensor S, an actuator A, a 
buffer with queue size — 1, a comparator with event-triggering rule || Xk ||cx;> £, and an unreliable communication link. 

actuator reads the predicted control command for the current time from the buffer and applies 
this input to the plant. In this context, we are interested in deriving analytical performance 
guarantees, both in terms of control performance and the number of transmission attempts on 
the communication link between controller and actuator. 

B. Process model 

The dynamics of the plant Q can be described by the stochastic discrete-time linear system: 

Xk+i = Axk + Buk + Wk, (4) 

where Xk G MP is the state variable, Uk G is the control signal, and Wk G M” is a discrete¬ 
time zero-mean Gaussian white noise with covariance G S^g, i.e., Wk ~ A/’(0„,Su,). The 
initial state Xq is modeled as a random variable having a normal distribution with zero mean 
and covariance Eg G S”g, i.e., Xq ~ A/’(0„, Eg). The process noise {wk}k&No is independent of 
the initial condition Xq. 

The system matrix A G and the input matrix B G are constant, and B is assumed 
to be of full column-rank. Furthermore, the system (4) with Wk = for all /c G Ng is assumed 
to be completely z/-step controllable for some u < n. In other words, for every Xk G M”, there 
exists a control sequence U = {uk,Uk+i, ■ ■ ■ ,Uk+,y-i} that transfers the state from Xk to the 
origin in u time steps. When A is non-singular (which it will be if it is obtained by sampling a 
delay-free continuous-time linear system), the system (4) is completely z/-step controllable [37] 
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if and only if 

rank[yl“^i?, A~^B, • • ■ , = n . 


C. Controller design and performance criterion 


We quantify the closed-loop performance in terms of the quadratic cost 


Joo = lim — 

N^OO iV 


N-1 

E 

k=0 


xlQxXk + pulQuUi, 


(5) 


for given symmetric positive semidefinite matrix and symmetric positive definite matrix Qu. 
We are particularly interested in the case when p —)■ 0, sometimes called the cheap control 
scenario', see, e.g., [38]. It is well known that the optimal controller for the cheap control 
scenario is a dead-beat controller which ensures that, in the absence of process noise, the state 
converges to zero in a finite number of steps [2]. Our analysis framework considers a standard 
linear dead-beat controller 


Uk = Kxk , ( 6 ) 

and a cost of the form (5). When the system is completely z/-step controllable, one can always 
find such a controller K that drives the system state to zero in v steps (see e.g., [37]). 

We use a packetized dead-beat controllerto reduce transmissions over the communication 
channel and to guard against losses. If the event-triggering rule leads to the controller executing 
the control algorithm at time k G No> it computes and transmits a sequence of control commands 

Uk = {Kxk, K{A + BK)xk, ■■■ ,K{A + BKf-^Xk} (7) 

which would transfer the process state of (4) from a;?; to the origin in at most u < n time steps in 
the absence of process noise. We assume the presence of a buffer of length z/ — 1 at the actuator. 
When a new set of control actions arrives from the controller, the actuator immediately applies 
the first control action in the set, and stores the rest of the control actions in a buffer, see Fig 1. 
In the next u — 1 time steps, the controller issues no transmissions even if the event-triggered 
condition is met. Rather, the actuator applies the control commands sequentially from the buffer. 
If the buffer is empty, the actuator applies zero input (cf. [39]). Note that this is consistent with 
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the dead-beat assumption: in the absence of noise, the state would be at the origin after v steps 
and (6) would evaluate to zero. 

After each successful packet transmission, the controller is switched off for z/ — 1 time steps, 
and then it is switched on again. The controller uses a simple threshold-based rule 

II ||oo^ ^ (8) 

to determine if a new control sequence should be computed, and a transmission should be 
attempted between the controller and actuator. We assume that the communication primitive 
offers reliable acknowledgements, so that the controller node knows if a transmission attempt 
to the actuator node was successful. In addition, we introduce a time-out mechanism where, if 
the number of samples since the last successful transmission exceeds a time-out value of T, the 
controller will attempt to transmit new data to the actuator even if the plant state does not satisfy 
the triggering condition (8). Such a time-out mechanism, admittedly essential to our analysis, is 
also important in event-triggered control system to guard against faulty components. It is worth 
noting that the time-out T is a design parameter which is not directly related to v. 

D. Communication channel 

The communication channel between the controller and actuator is lossy, and packets trans¬ 
mitted from the controller to the actuator are dropped with a probability G (0,1), independent 
of all other events in the system. If a transmitted control packet is dropped, the transmission 
of a new control command will be attempted in the next sampling instant, irrespectively of the 
state evolution. 

E. Discussion 

At any time k G No> the system can operate in one of three modes: (a) we choose not to 
transmit any information, but let the actuator use data from the buffer; (b) we attempt to transmit 
a new packet, but it is dropped by the communication link; or (c) we succesfully transmit a new 
control sequence from the controller to the actuator. 

At first glance, it might appear that the system (4) with a packetized dead-beat controller (7) 
is a Markovian Jump Linear System (MILS). However, this is not true since the transmission of 
control updates under the event-triggering rule depends on the plant state (i.e., the Markov jump 
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process depends on the continuous state variable). Thus, traditional techniques for analyzing the 
long-run average of control performance, such as [40], cannot be applied. In fact, our system fits 
into the class of the state-dependent random-time switched systems, which are hard to analyze 
in general; see e.g., [41]. Nonetheless, we, here, propose a technique which allows us to analyze 
a similar class of problems when the control sequence satisfies a dead-beat assumption. 

III. Event-triggered control of first-order systems 

For pedagogical ease, we first restrict our attention to the case when the plant ^ is a first-order 
system. In other words, m = n = 1. To emphasize that A and B are scalars, we write A = a, 
B = b and the covariance matrices as and Sq = (Jq. The corresponding dead-beat 

controller is K = —a/h and since z/ = 1, no buffer is needed at the actuator. 

In Section III-A, we consider a reliable communication channel between the controller and 
actuator (i.e., p(, = 0). The extenion to packet dropouts is given in Section III-B. Proofs of 
technical results are presented in the Appendix. 


A. Control over perfect channel 

Assume that the controller-actuator communication is reliable, that is = 0 and that ^ is a 
first-order system. For convenience, we rewrite the evolution of the process {xk} as: 


Tfc-|-1 fk{j'k)Xk T ITfc , 


(9) 


with initial condition xq (correspondingly tq G {0,1}) and 




Jo if rfc = 0 , 

I a otherwise , 


( 10 ) 


where ta, G M denotes the state of the process, and Wk is a zero-mean Gaussian white noise 
process with positive variance and Wk is independent of Xq. The process {rk}k&No describes 
how many time steps ago the latest transmission of a control packet occurred. Whenever = 0, 
a control packet is transmitted from the controller to the actuator. It is also worth noting that the 
number of time steps between two consecutive transmissions is bounded by the time-out interval 
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T G Nq. To this end, the evolution of the process {r^} is defined by 

{ 0 if \xk+i\ > e or rfc > T , 

( 11 ) 

Tk + 1 Otherwise . 

Since the dead-beat control resets the plant state Xk whenever {r^ = 0}, the stochastic recurrence 
equation (9) can be re-written as 

rk 

Xk+i = 'Yla^Wk-i . ( 12 ) 

1=0 

This implies that the probability of an event-threshold crossing at any time k only depends on 
a, (Tg, and the current value of r^. Hence, the evolution of the system can be represented by 
the Markov chain {r^} shown in Fig. 2. 


Lemma 1 The process {rk}k£No Is an ergodic, time-homogeneous Markov chain (i.e. irre¬ 
ducible, aperiodic and positive recurrent) with a finite state space = (0,1, • ■ ■ , T} and it has 
a unique invariant distribution tt such that tt* > 0 for alH G 

To characterize the transition probabilities 

Pij = P(rfc+i = j \ rk = i) , 

of the Markov chain {rk}, we introduce the random processes 

i 

ik{i) = y^^a^Wk-j , (13) 

i=o 

for alH G {0,1, • ■ ■ , T — 1}. The probability density functions of ^k{i) are time-invariant since 
the noise {wk}keNo Is white and stationary. Hence, we can drop the time k index to simplify 
notation. Observe that the vector-valued random variable ■Ci ''' Ci] ^ has a multi-variate 
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Pro 



Fig. 2. The transition graph of Markov chain {r*} with transition probabilities pij; this Markov chain has T + 1 states labelled 

O,--- ,T. 


normal distribution with mean E = 0* and covariance matrix E = Sj with 


"k 


aa:, 




ELo 




ELo 


(14) 


For any i G (1, • ■ ■ , T}, we define the events 

2—1 

=n {I I ^ 4 

i=o 

with the convention that is a sure event. Thus, we have 


(15) 


P(Jt) = E(elj; 0*, Sj), 


(16) 


with P(J^o) = 1- The transition probabilities can now be computed using the following lemma: 


Lemma 2 The transition probabilities Pij in the Markov chain {r^}, defined in Fig. 2, are 


r 


1 F’(eli+i;Oi+i,Si+i) 

if f e {0, • 

■■ ,T- 

1},J 

F(eli;0„Si) 

1 

if i = T, j 

= 0 


1 -PiO 

if i e (0, • 

,T- 

1},J 

0 

otherwise . 
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A visit of the Markov chain {r^} to state 0 corresponds to a transmission of the control signal 
from the controller to the actuator, and therefore, in the view of the ergodic theorem, 

1 ” 

TTo = lim - l{rfe=0} (IV) 

n^oo n 

fc =0 

is the emprical frequency of transmissions. With the transition probabilities of the Markov chain 
at hand, we can give an explicit characterization of the expected communication rate of the event 
triggered control system: 


Theorem 3 (Communication rate) The expected communication rate between the controller 
and the actuator for the event-triggered algorithm is given by 


TTo = 


1 

1 + Sn=l nm=o(l “ 


(18) 


We are also able to give an explicit characterization of the expected linear-quadratic loss: 


Theorem 4 (Control performance) Consider the problem formulation in Section II with the 
event-triggering algorithm and the standard dead-beat controller (i.e., K = —a/h). For a given 
event-threshold e > 0, the empirical average of the control loss function can be computed as 

r T -i 


Jog 


Q^l 


E 


g,s,_i + gs,^) J](i-p,o) 


TTo 


(19) 


i=l 


j=0 


where g = g^ -t- pK'^QuK, and 

Si = Var[^i I J^i+i] , i e [0,T - 1] , 

Sf = Var[g I |g| > e, J'i] , i e [0,T - 1] , 
S| = a^Varf^T-i I^t] 

and J^i defined as in (15). 
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Remark 5 The analytical calculation of the control performance of an event-triggered control 
system with an arbitrary controller (except dead-beat controller) seems interactable since it is 
not possible to provide the closed-form of the probability density function of the state Xk at 
any time step k e No. 


Remark 6 It is worth noting that the communication rate and control performance are defined 
by analytical expressions of the mean and variance of truncated random variables. These means 
and variances do not have explicit closed-form expressions, but can be computed efficiently. 


Together, these results provide analytic expressions for the communication rate and the empri- 
cal average of control loss, for any given threshold e. Next, we investigate how these expressions 
change when the probability of loss between controller and actuator is non-zero. 


B. Control over lossy channel 

With the basic intuition gained from analyzing the Markov chain that models the loss-free 
scenario (see Fig. 2), we now consider the case when the channel between the controller and the 
actuator exhibits packet loss. Recall that if a transmission fails, then the controller will compute 
a new control command at the next time instant and attempt to transmit this to the actuator. 

Consider the following discrete-time scalar system: 


^k+l Tfc)^fc T ^k 


( 20 ) 


with initial conditions Xq, (correspondingly tq G {0,1}) and 70 , and 


Tfc) 


0 if (rfc = 0 A 7 fc = 0 } 


( 21 ) 


a otherwise 


where 7 ^ denotes the number of consecutive transmission failures that occurred immediately 
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(1 - Pf)pTO 



Fig. 3. A bidimensional Markov chain {rk,yk) which illustrates the packet loss in the network. 


before time step k G Nq. The process (rfc,7fc) evolves according to 


Ffc+l 

7fc+i 


0 

LoJ 

[?] 

w.p. 1-pe 

w.p. pe 

if {Ixfc+il > e A7fc 

[§] 

[?] 

w.p. l-pe 

w.p. Pe 

if {rfc > T A 7fc = 

[§] 

[.:«] 

w.p. 1-pe 

w.p. Pi 

if 'Ik 7^ 0, 

[’■y] 


otherwise . 


( 22 ) 


Lemma 7 The process {rk,'yk), k e No is an ergodic, time-homogeneous Markov chain in a 
countably infinite state space B = B x Nq with a unique invariant distribution tt. 


The behavior of the event-triggered communication with packet losses is described by the 
bidimensional Markov chain (r^, 7 ^.), shown in Fig. 3, with state-space B. Note that this Markov 
chain has a countably infinite state-space. The transition probabilities for the Markov chain 
depend on the packet loss probability pi and the transition probabilities already characterized 
in Lemma 2 for the loss-free case. Thus, we now have all information necessary to derive the 
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expected rate of attempted and successful transmissions from the Markov chain. 


Theorem 8 (Communication rate) Under the event triggering mechanism (defined in §II-C), 
the expected rate of the successful reception of control packets at the actuator is calculated as 


'^00 — 


1 

©0 + ©n nm=o(l ~ Pmo) 


(23) 


where 0j = ^ Vi G {O,--- ,T}, and the expected rate of attempted transmissions 

between the controller and actuator is obtained as 


TJ'oo — 


1 

1 + Sn=l nm=o(^ ~ Pmo) 


(24) 


Remark 9 Note that we consider a discrete-time stochastic system whose underlying Markov 
chain has a countably infinite state-space. Typically, the solution of optimal control problems 
for such systems rely on the study of a countably infinite set of coupled Riccati equations (e.g., 
[42, 43]) and can only offer numerical approximations of the long-run average cost. In contrast, 
our framework with the dead-beat control assumption yields an anlytical characterization of the 
control performance that allows for efficient numerical computations. 


Theorem 10 (Control performance) Consider the problem formulation in Section II with the 
event-triggering algorithm and the dead-beat controller described in Section II-C. Suppose that 

Peo^ < 1 , 


Then, for a given event-threshold e > 0, the empirical average of the control loss function is 


Joo 


PooQ{^1+ 


V 


1 


+ 5 : 


2 = 1 


Qx^i-1 +PioQ{ + 


PeK 

^-Pe 


i— 1 


i=o 


TToo, (25) 
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where Q = peKQ^+pK'^Q uK)+piQ^ truncated variances: 

^ l-pea^ 

S, = Var[e*|-^m] , *e[0,T-l], 

Sf = Var[e* I U>e,J^,] , * e [0, T - 1] , 

SJp = a^Varf^T-i | J^t] + (^1 , 

and J^i defined as in (15). 


Remark 11 Notice that the condition p^a? < 1 is identical to the necessary and sufficient 
condition for stability of scalar systems under periodic control over packet drop channels; 
see e.g., [44]. Accordingly, this condition must be satisfied to compute a finite control loss for 
our set-up. 


IV. Event-triggered control of higher-order systems 

We present our result in two steps. Section IV-A outlines the results for the vector case with 
arbitrary n when packet loss Pi = 0. We extend our analysis to the case with packet dropout in 
Section IV-B. 


A. Control over perfect channel 


In this subsection, we extend our results to the case when the process state is a vector. 
This is not a trivial extension. Unlike the scalar case, the control packets now need to be stored 
in a buffer at the actuator. Even when there are no packet losses, the one dimensional process 
{rfc} becomes a bidimensional process {rk,Pk)- At each time instant k G Nq, the controller C 
uses the state of the system (4) to calculate and send a packet with a sequence of control 
commands as described in (7). We can rewrite the evaluation of the process {xkjkeNo of (4) as 
follows: 



Axk + Wk 

+ E ^^Wk-i 
1=0 


if { II Xk ||oo< eApk 

otherwise , 




(26) 


January 6, 2015 


DRAFT 



DRAFT. 


17 


where 




\{A + BKy^k^ if r]k e {!,■■■ - 1} , 

[On, if ?7fc = 0 , 


and Tjk denotes the number of control packets in the buffer. 
The evolution of the process pair {rk,r]k) is defined by 


rk+i 

Vk+l 



if { II 


II oo ^ C 

A rjk 

[.N 

if [rk 

> T 

A rik = 

= o}> 

[8] 

if r]k = 

= 1, 




if rjk G {2, • 

,z/- 

■1} 

[’y‘] 

otherwise . 




(27) 


Lemma 12 The process {rk,rik), /c G No is an ergodic, time-homogeneous Markov chain with 
a state space B = B x {O,-- - ,u — 1} and it has a unique invariant distribution tt. 

The behavior of the event-triggered communication of the system (4) with the packetized 
controller (7) can be described by Markov chain (r^, T]k) (see Fig. 4). This discrete-state discrete¬ 
time Markov chain has (T-f 1) x z/ states*. Each mode is represented by two digits: the first digit 
denotes when the last transmission took place, and the second one denotes how many control 
packets are used from the buffer. 

To describe how the transition probabilities depend on the system parameters and the event 
threshold, we define the random variables, i.e., 

- [ Er=0 if 7 = 0 , 

f>i,k — < 

[ YaZI A^^^Wk-i + Y]~=o A^Wk+i-j if f 7^ 0 . 

for all i G (0,1, • • ■ , T — 1}. Note that we only consider the random variables that describe 
the evolution of states when there is no transmission, and when we reset the mean of the state 
because the rest of the events are sure events - the transition probabilities are equal to unity. 


‘Recall that v represents the controllability index of the system (4). 
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Fig. 4. A bidimensional Markov chain {rk,r]k) that illustrates the event-triggered transmission for high-order systems. 


Unlike the random variable ^ (defined in § III-A), ^ is vector-valued. However, the 
probability density function of 6i^k is also time-invariant since the noise process {wk}keNo is 
white and stationary. We thus neglect the time index to simplify notation and denote ^ by Si. 
Similar to the scalar case, the augmented random variable Aj„ A ^ a multi-variate 

normal distribution with mean E [Aj„] = 0^ and covariance matrix E [Aj„AJ^] = given by 

's* S*ylT ... 

* AT,*A'r + j:^ ... 

* * ... A^E*{A'^y+ 

j=o 

where S* A YldZo As defined in (15), we establish the events, for alH G (1, ■ ■ ■ , T}, 

i—1 

-A*=n {II lu^’ ( 28 ) 

i=o 

where Fq is a sure event. For the transition probabilities, we use the shorthand notation: 

P((A, ji) I (*o, jo)) = P{{rk+i,Vk+i) = (A, ji) I {rk,Vk) = (*o, jo))- 


The transition probabilities can now be computed using the following lemma. 
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Lemma 13 The non-null transition probabilities of the Markov chain {rk,rik), k E No, shown 
in Fig. 4, are 


where 


P((0,i^-1) 

1(0,0)) = 

Po , 



P((1.0) 1 (0, 

0)) 

1 -Po , 




1(^,0)) = 

Pi, i ^ 

[1,T- 

1], 

P((i + 1,0) 

(*,0)) = 

1 - Pi , i E 

[1,T- 

1], 

P((T,i.-l) 

l(T,0)) = 

1, 



P((».J-1)I 

ihj)) 

1 , i E 

[0,T], 

j e[1,u-1] , 

Pi ^ 1 - 

F{elin, 

{i+l)n, ‘^(i-l-l)n) 

Om? ^in) 

Vi e 

[0,T-1] . 


We now proceed to characterize the analytical model of the communication frequency in case 
the communication between the controller and the actuator. 


Theorem 14 (Communication rate) The expected communication rate between the controller 
and the actuator for the event-triggered algorithm is obtained as 


TI'OO 


1 

0o + EL0*n;=i(i-p.)’ 


with 0j = 1 -f (z/ — l)pi, Vi e {0, • ■ ■ .T}. 


(29) 


The next theorem characterizes the expected linear-quadratic loss: 


Theorem 15 (Control performance) Consider the problem formulation in Section II-B with 
the event-triggering algorithm and the control strategy described in Section II-C. For a given 
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event-threshold e > 0, the empirieal average of the linear-quadratie eontrol loss is eomputed as 

T r H ' 

Joo = PojXo + Z) + Tr((5xSj_i)-f Pi(Xj-|-Z) TJ'oo 5 (30) 

i=l 1 -I 1=0 

where, for alH G {0, • ■ ■ , T}, 

ly-l 

X. = , 

j=0 
u-2 j 

j=0 1=0 

with Q = Qx + pK'^QuK, Ac = A + BK, and the truneated eovarianees: 

Si = Cov [5i I Xi+i] , i e [0, T - 1] , 

S)= = Cov[5i III 5i ||oo> e,Xi] , ie[0,T-l], 

SSj. = y4Cov[5x-i I + S^ . 

and Bi defined as in (28). 

The aforementioned results allow one to obtain analytieal expressions for the eommunieation 
rate and the empirieal average of the eontrol loss for any given event-threshold e > 0. 

B. Control over lossy channel 

If the state veetor Xk is transmitted over the lossy ehannel between the eontroller and the 
aetuator, the behavior of the event-triggered eommunieation with paeket losses is deseribed by 
the three-dimensional Markov ehain {rk,'yk,Vk), k G No with eountably infinite state spaee. The 
Markov ehain ean be obtained from the one depieted in Fig. 4 using the same teehnique that 
was used to generalize the Markov ehain of § IV-A to that of § IV-B. To eompute the transition 
probabilities for this Markov ehain, it is eonvenient to use Lemma 13, derived in the previous 
subseetion. In faet, we have all neeessary information to derive the expeeted rate of sueeessful 
transmissions beeause the paeket-loss probability is the only additonal parameter. 


January 6, 2015 


DRAFT 



DRAFT. 


21 


Theorem 16 (Communication rate) Under the event triggered mechanism (defined in §II-C), 
the expected rate of successful reception of control packets at the actuator node is obtained as 


TJ'OOO — 


1 

©0 + Ya=i ©* 11^=0(1 “ Pj) 


(31) 


with 0j = 1 + {v — l)pi + ^ {O)''' the communication rate between the 

controller and the actuator is computed as 


TTOOO — 


1 

©0 + Ya=i ©* 11^=0(1 “ Pj) 


with 0j = 1 + (z/ — l)pi, Vi e {0, • ■ ■ .T}. 


(32) 


The next theorem characterizes the expected linear-quadratic cost. 


Theorem 17 (Control performance) Consider the problem formulation in Section II with the 
event-triggering algorithm and the dead-beat controller described in Section II-C. Suppose that 

P£-^max(^) ^ 1 • 

Then, for a given event-threshold e > 0, the empirical average of the control loss function is 


Voo 


Po 


u-1 


' l-K ^ 


=1 1- 


Tr(g,S,_i) 


u-l 


j=0 -I 1=0 


i— 1 


TJ'ooo , (33) 


where 


Xij = Tr(^0j((l -f j , 

F, = Tr(T((l-p,)E,^ + p,S^)) , 

v-2 j 

Z= 5^^Tr((AgU2l'S^) , 

j=0 1=0 
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with, for all j G {0, • • • , z/ — 1}, 

T = lyap(v^/lT,(3j , 
e, = ly!,f(^eA\AVQAi,) , 

where Q = Qx + pK'^QuK, Ac = A + BK and the truneated varianees: 

Si = Cov I Bi+i] , i e [0, T - 1] , 

S- = Cov[5i III ||oo> e, j;] , ie[0,T-l], 
S^ = ACov^^t-i I + S^ . 

and Bi defined as in (28). 


Remark 18 Note onee again that the eondition pi\raa.^{AY < 1 is a natural assumption needed 
for the stabilization of the system (4) by any eontrol algorithm when the eontroller-aetuator 
eommunieation is aeross an unreliable link with the erasure probability pi G (0,1); see e.g., [44]. 


V. Numerical Examples 

We will now illustrate how the analysis teehniques developed in Seetion III allow us to study 
the trade-off between the eommunieation rate and the elosed-loop performanee for the event- 
triggered seheme detailed in Seetion II. 

A. Event-triggered control for first-order systems 
We first eonsider a sealar linear stoehastie system 

“f Ufi; “t“ IP/;; , 

where {wk}kmo ^ zero-mean Gaussian white noise proeess with varianee = 1.44. The 
initial state xq has a normal distribution with zero mean and varianee (Tq = 1.0. We eonsider a 
eheap eontrol seenario, where Qx = Qu = ^ and p —)■ 0, whose optimal eontrol under periodie 
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Fig. 5. A comparison of the successful reception rate (resp. control performance) obtained from the analytic expressions (3) 
and (8) (resp. (4) and (10)) and Monte Carlo simulations for several packet loss probabilities; e.g., pi € {0,0.2,0.3}. The 
marked curve with "o" is obtained by averaging 10,000 Monte Carlo simulations for the horizon length 25,001 samples with 
the process noise {wfcjfegNo and the initial condition a;o generated randomly. 


sampling is the dead-beat eontrol law up = —l.Gxfc. The number of sample times between two 
eonseeutive transmissions is upper-bounded by the time-out interval T = 5. 

In Fig. 5, we examine the eommunieation rate and the eontrol loss predieted by Theorem 3 
and 4 in the absenee of paeket loss (i.e., p£ = 0) for different thresholds e > 0. We first note how 
the analytieal results (solid line) matehes the Monte Carlo simulations (eireles) almost perfeetly. 

Next, we observe that ehanging the threshold from 0 (periodie eontrol) to 1 yields signifieant 
reduetion in the eommunieation frequeney at the expense of a small inerease in the eontrol loss. 
On the other hand, inereasing the threshold from 2 to 4 only brings little (absolute) reduetion in 
eommunieation, but eauses a large degradation in the elosed-loop performanee. Sueh observations 
may be useful for designing the event-triggering seheme. 

Fig. 5 also shows how the sueeessful reeeption rate and the eontrol loss are impaeted by a 
lossy eommunieation ehannel (Theorem 8 and 10). Again, the analytieal model has nearly perfeet 
eorrespondanee with Monte Carlo simulations. Moreover, we note that loss rates up until p£ = 0.2 
have have only a small effeet on the eommunieation rate and elosed-loop performanee, while 
P£ = 0.3 leads to a speeified performanee loss eompared to the ease of reliable transmission. 
Reeall that if the paeket loss probability is larger than p^ = 1/1.6^ ~ 0.3906, the event-triggered 
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0.2 0.4 0.6 0.8 1 

Communication rate 

Fig. 6. The control performance for different communication frequency and the event thresholds (shown in gray scale). 

control system will be unstable. 

An alternative visualization of the trade-off between control loss and communication rate 
is shown in Figure 6. Different points on the curve correspond to different even thresholds 
ranging from 0 to 4 and communication rates and control losses are calculated using Theorem 3 
and Theorem 4, respectively. Note that the communication rate decreases dramatically with an 
increased control loss as the threshold e varies between 0 and 2.25 (dark colors). For e > 2.25 
(lighter color), both quantities become less sensitive to changes in the threshold value. We 
can also identify e G [0, 0.8] as a particularly attractive region where a large decrease in the 
communication rate can be obtained for a small loss in control performance. 

B. Event-triggered control for high-order systems 

Next, we consider a second-order plant with state-space representation 

2.2 - 1.2 0.8 

^k+l = + fffc + '^k ■ 

1 0 0.4 

For the periodic cheap control with Qx = [o i]’ Qu ~ 1 P —^ 0, the optimal controller is 

Uk = [-f -|] Xk . 

This control is of dead-beat type and drives any system state to the origin in two time steps. The 
consider the initial condition Xq as a Gaussian random variable with zero mean and covariance 
^0 = [%‘^ie while the process noise {wk}keno is white, zero mean, Gaussian with covari¬ 
ance = [ Q ^2 V ] • The process noise and the initial condition are mutually independent. The 


January 6, 2015 


DRAFT 




DRAFT. 


25 


o 



Event threshold e 

Fig. 7. A comparison of the successful reception rate (resp. control performance) obtained from the analytic expressions (29) 
and (31) (resp. (30) and (33)) and Monte Carlo simulations for several packet loss probabilities; e.g., pt G {0,0.2,0.3}. The 
marked curve with "o" is obtained by averaging 10,000 Monte Carlo simulations for the horizon length 25,001 samples with 
the process noise {wk}keNo and the initial condition xo generated randomly. 

time-out interval is set to T = 4. 

As shown in Figure 7, the analytical results obtained in Theorem 14 and 15 match Monte 
Carlo simulations perfectly. Note that the successful communication rate is limited to 0.5 since 
u = 2. Therefore, the event-triggered control sends at most one packet every two sampling 
instances. Apart from this, the behaviour is qualitatively similar to the scalar case. 

Figure 8(a) highlights the differences between our packetized event-based control algorithm 
and the threshold-based event-triggered control algorithm, formed as 

{ Kxk if II Xk ||oo> e , 

0 otherwise . 

For the lossless case (p£ = 0), Figure 8(a) shows that the packetized event-triggered control 
outperforms the standard threshold-based implementation as long as the average successful 
transmission rate is smaller than 0.5. If we allow for higher communication rates, then the 
standard implementation performs better on average. 

The differences between the two variations are more striking in the case of packet losses. 
Figure 8(b) compares communication vs control trade-off for the packetized and the standard 
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Communication rate Communication rate 

(a) pi = Q (b) Pi = 0.2 


Fig. 8. A comparison of the communication rate and the control performance of the event-triggered control system with and 
without packetized dead-beat controller for two packet loss rates: (a) pr = 0 and (b) pi = 0.2 (event threshold is shown with 
gray scale). The marked curves with "o" and "o" are obtained by averaging 10,000 Monte Carlo simulations for the horizon 
length 25,001 samples with the process noise {infe}fegNo and the initial condition aso generated randomly. 


implementation of the threshold-based event-triggered control when the loss rate is 20%. In 
this case, the packetized implementation strictly dominates the standard implementation, and 
when a comparable performance is searched for, this can be done at a dramatic decrease in 
communication cost. This performance improvement can be understood by observing that to 
reset the state Xk in absence of the process noise, it is neccessary to apply two consecutive 
control commands computed by the dead-beat controller. Whenever the packetized controller 
succeeds in transmitting a packet, this sequence of control commands will be available to the 
actuator and can be applied without interruption. In the standard implementation, on the other 
hand, the likelihood that consecutive packet transmissions will be successful is only (1 — piY- 
Therefore, the state will often not be brought back close to the origin after an event triggering. 

To conform with the guidelines of reproducible research, the R/Mat lab file to generate the 
results presented above is publically available at people.kth.se/~demirel/publication. 

VI. Conclusions 

In this paper, we developed a theoretical framework to analyze the trade-off between the 
communication cost and the control performance of an event-triggering algorithm for control over 
an unreliable network. We assumed that a threshold-based event-triggering algorithm governs 
the channel used to transmit the information from the controller to the actuator. Additionally, 
we assumed the presence of a buffer at the actuator to store the control command sequence 
received from the controller to mitigate the detrimental effect of packet loss. Furthermore, we 
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developed a multi-dimensional Markov chain model, which characterizes the attempted and 
successful transmissions of control signals over an unreliable communication link. By combining 
this communication model with an analytical model of closed-loop performance we provided a 
systematic way to analyze the trade-off between the communication cost and control performance 
by appropriately selecting an event threshold. 


VII. Appendix 

Proof of Lemma 1: We begin by proving that the process {rfcjfceNo is a Markov chain. Let us 
consider the case where Xk+i belongs to M which is an uncountable state space. Using the total 
law of probabilities, we have: 


P(rfc+i |rfc,rfc_i,--- ,ro) = / P(rfc+i,a;fc+i - ,ro)dxk+i 

Jr 

/ P(rfc+i \ Xk+i,rk,rk-i, - ■ ■ ,ro)P{xk+i \rk,rk-i,--- ,ro)dxk+i 

f P[rk+i,Xk+i\rk)dxk+i 

Jr 

= P{rk+i I Tk ) 


where (a) and (c) come from the definition of the conditional probability, and (b) holds because 
Xk+i depends stochastically only on as described in (12), and r^+i depends on Xk+i and 
Tk as described in (11). It is also worth noting that knowing = j implies that knowing 
f'k = j, - ■ ■ , Tk-j = 0. Therefore, the process {r^} is a Markov chain. 

We next proceed to show the ergodicity of this Markov chain. Since the Markov chain {r^}, 
shown in Fig. 2, has positive transition probabilities for any e > 0, the chain is clearly irreducible. 
Furthermore, the chain is aperiodic because state {r^ = 0} has a non-zero returning loop for any 
e > 0. By [45, Thm 3.3], this irreducible chain with finite state space B is positive recurrent. 
The process {r^} is irreducible, aperiodic and positive recurrent; therefore, it is also ergodic. As 
{r'k} is an irreducible aperodic Markov chain with finitely many states, it has a unique invariant 
distribution tt such that ttP = tt and ttI = 1; see [46, Cor 2.11]. This concludes our proof. ■ 

Proof of Lemma 2: We focus on the case when f G {0, • • • , T — 1}, j = 0 because the other 
expressions are obvious from the structure of the Markov chain in Fig. 2. Let us consider the 
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transition probability poo- Since = 0 is equivalent to 0^ = 0, we have: 

Poo = P{rk+i = 0 I Tfc = O) 

= P(| Wfc I > e I = O) 

^=^P(| Wk I >e) =P(| ^0 I >e) , 


where (a) holds because (pk is independent of the process noise at time step k G Nq. Similarly, 
for any i G {1, • • ■ , T — 1}, we have that: 


PiO = 


= 0 

Tk = 



(A) 


= 0 

Tk = 

i,rk-i = i - 

1, • ■ ■ ,rk-i = O) 

A) 

P(l 6 

> e 

1 1 e*-] 

L 1 < e,••• ,1 

T 

VI 

o 

(d) 

P(l 6 

> e 

1 1 6-1 

L A e, • ■ ■ ) 

VI 

o 


P(l«. 1 

> e, 

J^^) _ 

, P(ri+, 

) 


P(J-,) P(J-,) 


where (b) comes from the Markov property, (c) follows the definitions in (13), and (d) holds 
because 4>k-i is independent of the process noise after time step k — i, and in particular, ^i. Lastly, 
the combination of these expressions and (16) yields the desired result, evaluated by Gaussian 
integrals (2). ■ 

Proof of Theorem 3: The Markov chain {r^}, depicted in Fig. 2, is aperiodic, positive recurrent, 
finite, and irreducible, therefore; the Markov process has a limiting distribution which is also a 
stationary distribution {ni : i E B). By the ergodic property, i.e., nj = obtain: 


T 



(34) 

j=0 


(l-Pi_i,o)7ri_i, iG{l,---,T}. 

(35) 


Combining the balance equation X]J=o ^ ^ aforementioned equalities, we thus get: 


TTO 


1 

1 + Z]n=l nm=o(l “ P-mo) 


(36) 


This concludes our proof. 
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Proof of Theorem 4: The Markov chain is aperiodic and positive recurrent on the 

countable state space B = {0, • ■ ■ ,T}. Therefore, the process {rk}k(zf^g is an ergodic Markov 
chain with stationary distribution tTj = lim P(rfc = j) for all j G B. By the ergodic theorem 

k^oo 

for Markov chains [45, pp. Ill], the linear-quadratic loss (5) converges to 

1 ^ 

M = lim E,, [xlQr^x^]. (37) 

N—>-cx) iV k^oo 

k=0 

Note that (37) holds since x^+i is a function of r^, i.e., Xk+i = ^ki^k) = 
law of total expectation, we have: 

i£B 

where 


Hk,i = E[xl \ Tk = i]P{rk = i) , 

with Qo = Qx + pK'^QuK and Qi = Qx, Vi e {1, • ■ ■ , T}. 

Using the law of total expectations and Bayes’ rule, we thus obtain: 

E[xl \rk = i] = '^E[xl \ rk = i,rk-i = j]P(rfe_i = j | = i) , 


jee 


'^E[xl I r-k = i,rk-i = j]P{rk = i \ P , 

[xl \rk = i, Tk-i = j] • (38) 


j&B 
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By using (38), for = 0, we obtain that: 

T 

Hkfi = '^PjoE,[xl I Vk = 0,rfc_i = j]P(rfc_i = j) 
i=o 

= pm'E[xl I \xk\ > f-Ak-i = 0]P(rfe_i = 0) 

T-l 

+ I \^k\ > e, \xk-n\ < e, 1 < n < j,(j)k-j-i = 0]P(rfe_i = j) 

i=i 

+ E[xfe I \xk-n\ < e, 1 < n < T,(j)k-T-i = 0]P(rfc_i = T) 

= poo^[xl I \xk\ > f-Ak-i = 0]P(rfe_i = 0) 

T-l 

+ I \^k\ > e, \xk-n\ < e, 1 < n < j,4>k-j-i = 0]P(rfe_i = j) 

i=i 

+ (a^E[xl_i I \xk-n\ < e, 1 < n < T,(j)k-T-i = O] + (j^^P(rfc_i = T) . 


Similarly, for any i G {1, 2, • ■ ■ , T}, we have that: 


Hk,i = Pi-1,iE[xl I Tfc = i,rk-i = i - l]P(rfc_i = i - 1) 

= Pi- 1 ,i^lxl I \xk-n\ < e, 0 < n < i,4>k-i = 0]P(rfe_i = i - 1) . 

Substitution of Xk = into (39) and then into (40) yields 


(39) 


(40) 


Hk,o = PooE[ek-i{ 0 ) I 16 - 1 ( 0)1 > e]P(rfc_i = 0 ) 

T-l 

+ '^PjoE[^l-i{j) I 16-1 (j)I > e, l6-n-i(j - n)| < e, 1 < n<j]P{rk-i = j) 

1=1 

+ (a^P[ek- 2 i^ - 1) I l6-n-i(T - n)| < e, 1 < n < T] + al)p{rk-i = T) , (41) 

Hk,i = Pi-i,i'E[^l-i{i) I |6-n-i(i - n)| < e,0 < n < ■i]P(rfc_i = i - 1) , (42) 

for all i G {1, • ■ ■ ,T}. Let’s define Hi = lim Hk,i for all i e B. Letting /c —)■ cx), we can 

k^OO ' 

rewrite (41) and (42) as 

T-l 

Ho = pooVar[6 | |6I > + X!^'ioVar[6 | I6I > + (^a^Var[^T-i | 2 ^t] + cri^T^T , (43) 

1=1 

Hi = pi-i,iyar[^i-i I J’ijTTj.i = Var[^i_i | Hi]Tri . (44) 

Lastly, substitution of (43), (44) and tt* = n 7 =o(l ~ Pjo)'^o into Joo = lim 'FjT,\x\Qr^xA = 
XliggQj-ffi establishes (19). ■ 

Proof of Lemma 7: As in the proof of Lemma 1, the similar reasoning applies to show the 
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bidimensional process {rk,'yk) is a Markov chain. Firstly, for x^+i € we write: 


P(rfc+i, 7 fc+i I , tq; 7fc, 7fc-i,''' ,7o) 

= / P(rfc+i,7fc+i,a;fc+i I Tfc, • • ■ ,ro;7fc, ■ ■ ■ ,7o)'^a;fc+i 

Jr 

/ P(rfc+i,7fc+i I Xk+i;rk, ■■■ ,ro;7fc, • ■ ■ ,7o)P(a:fc+i | • • • ,ro;7fc, • ■ ■ 

Jr 

= p(rfc+i,7fc+i I rfc,7fc) 


,7o)cia; 


fc+i 


where (a) and (c) come from the definition of the conditional probability, and (b) holds because 
Xk+i depends only stochastically on and 7 ^.; r^+i and 7^+1 depend on x^+i, and 7 ^.. Notice 
that knowing Vk = i and 'jk = j implies knowing = i, • • ■ , rk-i = 0 and 'Jk = Jr " > Ik-i = 0. 
This concludes that the process (rfc, 7 fc) is a Markov chain. 

The proof is completed by showing the ergodicity of this Markov chain. As can be seen in 
Fig. 2, this chain is clearly irreducible. Moreover, the chain is aperiodic since it is irreducible 
and state (r^, 'jk) = (0,0) has a non-zero returning loop for any threshold e > 0. The distribution 
of the return time to state (0, 0) is 

Po(To = 1) = {l-Pi)poo , 


and, for n > 2 and m > 0, 


Po(To = n + m) = (1 -pe)pT{l - Poo) ■ ■ ■ (1 - Pn- 2 ,o)Pn-i,o ■ 
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Using the aforementioned distribution, we can write the expected return times as 

T+l 

E 

n—l m>0 


Eo[7o] = ^ ^(n + m)Po(To = n + m) 

1 


1 - W 


T i-l 

Poo + ^Pio na - P]o) 

i^l j^O 


T+l i-l 

i=l j=0 


< 


T+-S- = T 


= 1 

1 T(T+1) 


<1 


-Pi 


< 00 


and therefore the chain is positive recurrent. The process {rk,'^k) is an ergodic Markov chain 
because it is irreducible, aperiodic and positive recurrent. By [43, Thm 2.1], we conclude that 
this Markov chain has an invariant distribution tt > 0 such that for all j G B 

and ^ "This proves the lemma. ■ 

Proof of Theorem 8: The Markov chain (rfc, 7 fc), k e Nq (shown in Fig. 3) is aperiodic, 
positive recurrent and irreducible, therefore; the Markov process has stationary distributions 
: i G S,j e No). Using the ergodic property, we write that: 

T T oo 

TToo = (1 - Pe) 'Y^Pio'J^io + (1 - Pi) EE Tiij , (45) 

2 = 0 2=0 j = l 

TTio = (1 - Pi-1,o)7ri_i,o , ie{l,---,T}, (46) 


and 


T^ij 


PePioTTio if j = 1, 

PiTii,j-i if j ^ 1, 

for i e {0,1, • ■ ■ , T}. By combining (45), (46) and (47), we have that: 


T oo 


EE’^d = E (iTiO + TTil + 7120 + • • • ) — TiO + Til 

i—0 1—0 i—0 i—0 i—0 


1 , 

1 + 1 - Poo 

1 -pi! 


T 

Too + E 

i=l ^ 


1 , P^ 

1 + 1 PiO 
1 - pc 


TiO 


1 - pc(l - poo) ^ 


1 - pc 


■ 1 1 - PC ■ n 

1=1 *=0 


Too 


(47) 


(48) 


Using the balance equation E^o ^ ^ obtain (23). 
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Lastly, to compute the attempted communication rate, we only need to set = 0. Hence, we 
have (24). This concludes our proof. ■ 

Proof of Theorem 10: The proof follows an analysis akin to that in the proof of Theorem 4. 
The process {rk,'yk), k e Nq is an ergodic time-homogeneous Markov Chain (see Fig. 3) with 
stationary distribution iiij = lim Pfr^ = i,'yk = j) for alH G and j G Nq. Using the ergodic 
theorem for Markov chains [45, pp. Ill], we have that: 


Joo = lim = lim E^lxlQr^Xk]. 

N^oo N ^ k^oo L J 

fc =0 


It is worth noting that (49) holds because Xk depends stochastically on Vk-i and 7 ^- 1 , i.e., 

rk Ik 

Xk = By the law of total expectation, we have: 

n=0 m=0 


where 


Ett ^ ^ ^ ^ QijHk^ij ) 

ieB j'eNo 


(50) 


Hk,ij = E[xl\rk = i, 7fc = j] P{rk = i,'lk= j) (51) 

with Qoo = Qx + pK'^QuK and Qij = for alH G 13 and j G Nq. 

As in the proof of Theorem 4, we aim at defining recurrence equations H^^ij for alH G i3 
and j G No- For i = j = 0, the recurrence equation equate to 

Hk,oo = (1 -Pi) Poo'E[xI I \xk\ > e,4>k-i = 0]P(rfc_i = 0,7fc-i = O) 

T-l 

+ '^Pio'E‘[xl I \xk\ > e, \xk-n\ < e,l < n < i,(j)k-i-i = 0]P(rfc_i = i, 7 fc_i = O) 

i=l 

+ 'E[xI I \xk-n\ <eA<n<T= l,0fc_T-i = 0]P(rfc_i = T, 7 fc_i = O) 

00 

+ ^E[a:fc I \xk-j\ > e,(l)k-j-i = 0]P(rfc-i = 0 , 7 fc_i = j) 

j=i 

T-l 00 

-I- ^ I \xk-j \ > e, \xk-j-n\ < e, 1 < n < = 0]P(rfc-i = i,7fe-i = j) 

i=i i=i 
00 

+ '^E[xI I \xk-j-n\ < e, 1 < n < T, (3fe_j_T-i = 0]P(rfc_i = T, 7 fe_i = j) 
j=i 
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For any i G {1,2, • ■ ■ , T} and j = 0, we have that: 

^k,iO Pi—l,i^ I n| ^ ^ Tl OjP {t]^_ i i ^)’ (53) 

For any i G {0,1, • ■ ■ , T} and j = 1, we have that: 

Hk,ii = pePio'E[xl I Ixfcl > e, \xk-n\ < e, 1 < n < = 0]P(rfe_i = i,jk-i = O) . (54) 

For alH G {0,1, ■ ■ ■ , T} and j > 2, we have that: 

Hk,tj = Pe'E[xl I \xk-j+i\ > e, \xk-n\ < e, j <n< i+ j,(j)k-i-j = 0]P(rfc_i = i,^k-i = j - l) • (55) 


Hkflo = (1 ~ Pi) 

T-l 


Substituting Xk = a^ik-'y,,{i) + into (52), (53)-(55) yields 

PooE[^Li(0) I |a-i(0)| > e]P(rfc-i = 0,7fc-i = O) 

+ ^KoE[^Li(*) I l^fc-i(*)l > e, \ik-n-i(i - n)\ < e,l < n < i]P (rfe_i = i,7fc_i = O) 

i^l 

+ (a2E[^L2(T - 1) I |a-n-i(T - n)| < e, 1 < n < T] + )p(rfc_i = T, 7 fc_i = O) 

OO / \ 

+ H (o^^E[^^_^_i(0) I |Cfc-j_i(0)| >e] +(7^ ^a2Mp(rfe_i =0,7fe_i = j) 

j^l ^ 1^0 ^ 

T-l oo y j-1 V 

+ I ICfe-j-i(*)l > e, \^k-j-u-i{i - n)\ < e, 1 < n < i] + ^ 

X P(rfc_i = i,7fc_i = j) 

oo , j—1 , 

+ X a"' (a2E[CL,_2(T - 1) I |a-,-n-i(T -n)\<e,l<n<T]+al)+alJ2a^^] 

-1 — 1 5 7—n 


i-1 

X P(rfc_i = T,7fe_i = j) 


(56) 


and 


^k,io — i,iE 1(^ l)||^fc—n—i(i ^ 1 — ^ l57fc—1 — 

-fffc.il = WKoE[^fc_i(i) I |Cfc-i(i)l > £) l?fc-n-i(* - n)\ < e,l < n < 7]P(rfe_i = i,-fk-i = O), 


(57) 

(58) 


^k,ij — Pi 


i-2 


^20 i)e[^ 2 _^('-) I I^^_^(j)| > e, < e,l < n < 7 ] Gcr^ X' 


.2/ 


Z=0 


P(rfe_i = i,7fc_i = j - 1). 


(59) 
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We next define Hij = limfc^.oo Hk,ij for all f G and j G No- Letting /c —)■ cx), we can 
rewrite (56) as 


Hqq = (1 — Pi) 


T-1 


^p*oVar[(5i | |5i| > e, J'ijTTio + pTo(^a^Var[(lT-i | -T^t] + 


i=0 


T-l 




EE a^^Var[(li | |5i| > e,Fi] (^a^Var[5 t-i | -T^t] + 


i=0 j = l 

i-i ■ 

1=0 


1=0 


i=i ^ 


tttj 


(60) 


Note that i^oo contains the summations of infinite geometric series, and hence i^oo converges 
to an fixed value if the condition pio^ < 1 holds. Thereby, with the notation = Var[(5j | 
|(5i| > e, , i G {0, • • • , T — 1} and = a^Var [(5 t-i | ^t] + o-^, we rewrite (60) as 


T 


Hqo = (1 - pl)'^PioT,^TTiO + (1 - pi) ^ 


i=0 

T 

= i^-Pl)'^PiO 

i=0 

T 

= {^-Pe)'^Pio 


2 VC 


1 

1 -pia^ 


2=0 

T 

E 

i=0 


+ Sf + 


+ 


i=0 

Pl<^, 


1 — 




3=0 


Pia ^ 

1 - pia"^ 

l-pia"^ ' {1 - pi){l - pia"^) 
2 


E(wa^)^ + E^^ E 

j^o i=o /=o 

2 






3=0 


'^iO 


TTiO 


PtO 


Sf + 


Pe<^Z 

Pi 


'^iO • 


(61) 


As /c —)■ cx), (57)-(59) become 


II 

o 

-i.iVar[(lj_i 1 Ni]Tr,_i^o = Ei_i7rio, 



(62) 

Hii = pepM\ar[6i \ |5i| > e, Ai]7r,“ = 



(63) 

1 

r 1 


r 1 


II 

a^('^“i)Var[i5i | |(5i| > e,Ni] 

1=0 


„2t-I)2c + ^„»V2 

1=0 

TT^j. (64) 


By keeping ^lim 'E[xlQrf^Xk] = ZljeNo mind, we seperate the control loss 

function into two parts: Joo = Tetri + Toss- Firstly, we deal with Jctri as follows: 


Tetri 


T 

^OoLqo Qx ^ ^ HiO — 
i=l 


(1 — p^)Qoo 
1 - pea'^ 


E 

2=0 


P 2 O 


Pi<^l 

Pi 


T 

'^iO Qx ^ ^ E^—iTT^q . 
2=1 


(65) 
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Next, we obtain the performance deterioration Jioss, caused by packet losses, in terms of control 
loss as follows: 


T oo 

<^loss - Qx EEe [xl I Tk = ink =j]n 

1=0 j — l 


= q.E 

i^O 

T 

= q.E 


i-2 




i=2 


/=0 


2 = 0 
T 


= q.E 


2=0 L 


PiQx 
1 -pio^ 


^tY^ivio^y +picklYp^i E 

j=0 j=0 1=0 

' Sf 2^,1- 

3-T +pnw 2^P£ - 1 -3- 

1 — p/>a^ ^ 1 — 


E 

2 = 0 


P 2 O 




Pia. 


i-o 

2 




'^il 


w 


^-pt 


TTiO ■ 


( 66 ) 


Combining (65) and (66) with TTjo = n}=o(l ~ it is straightforward to varify the 

control loss function (25). This concludes the proof. ■ 

Proof of Lemma 12: Similar to the one of Lemma 7. ■ 

Proof of Lemma 13: The proof of Lemma 13 follows similar lines to that of Lemma 2, but 
an outline of the proof is included for completeness. We firstly concentrate on the cases when 
*1 = *0 = 0 ji = 1, jo = a, and ii = io ^ {1, • ■' ^ T — 1}, ji = 1, jo = 0. Similar to Lemma 2, 
the other expressions are obvious from the structure of the Markov chain, depicted in Fig. 4. 
We let consider the transition probability poo- Since (rfc,pfc) = (0, u) is equivalent to 0^ = 0„, 
we have: 


Poo = P((0, 1 ) I (0,z/)) , 

P( II Wk ||oo^ C I (pk On) ) 

^=^P(|| Wk ||oo>e)=P(|| ||oo>e), 

where (a), as Lemma 2, holds because cp^ is independent of the process noise at time step 
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k G No- On the other hand, for any i G {1, • ■ ■ , T — 1}, we have: 


Pa = P((7,l) I (i,0)) , 

= P((7,1) I (7,0),(7-l,0),--- ,(l,0),(0,z/)) , 

_ P( II ||oo> e, J'i) _ P(j'i+i) 

“ P(ji) “ P(-^*) ’ 


which follows the same arguments as those of Lemma 2. 
Proof of Theorem 14: Similar to the one of Theorem 3. 

Proof of Theorem 15: Similar to the one of Theorem 4. 

Proof of Theorem 16: Similar to the one of Theorem 8. 

Proof of Theorem 17: Similar to the one of Theorem 10. 
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